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Abstract 

A closed- loop, adaptive-control scheme that 
uses a least-mean-square filter as the controller 
model is presented, along with simulation results 
that demonstrate the excellent robustness of this 
scheme. It is shown that the scheme adapts very 
well to unknown plants, even those that are mar- 
ginally stable, responds appropriately to changes 
in plant parameters, and is not unduly affected by 
additive noise. A heuristic argument for the 
conditions necessary for convergence is presented. 
Potential applications and extensions of the 
scheme are also discussed. 


Introduction 

An adaptive controller is a controller that 
can change its behavior to maintain good control 
in response to changes in the process and inputs. 
One common approach to adaptive control is called 
Model Reference Adaptive Control (MRAC) , in which 
the specifications are given in terms of a refer- 
ence model which determines how the plant output 
ideally should respond to the command signal. In 
most MRAC schemes the controller is modeled as a 
differential equation in one of the common forms 
(i.e., transfer function or state space) with 
parameters that are adjusted to modify its behav- 
ior. A substantial advantage of such parametric 
modeling is that relatively fast convergence of 
the adaptive algorithm can be achieved as a result 
of the small number of parameters involved. How- 
ever, this approach requires that enough is known 
about the plant to construct a valid model. The 
resulting controller design can be quite complex 
and its performance strongly dependent on the 
assumed form of the plant model. 1 An excellent 
survey of adaptive control which discusses many of 
the problems of the parametric approach is found 
in Ref. 2. Concerns about the robustness of these 
schemes has also recently been expressed in 
Refs. 3 and 4. 

A different approach involves adaptive con- 
trol schemes based on impulse response modeling. 
Richalet^ modeled multivariable industrial pro- 
cesses with impulse responses and used these 
models off-line to determine the results of vari- 
ous possible input sequences. Widrow^ used what 
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is known as a least-mean-square (LMS) filter in an 
essentially open-loop MRAC scheme. The LMS fil- 
ter, which determines the coefficients of a 
moving-average model using a gradient algorithm, 
is a modeling approach that has been widely used 
in the communication systems field. ^ With this 
approach one attempts to produce an approximate 
impulse response of the desired system and not its 
exact mathematical form in terms of the coeffi- 
cients of a differential equation. This approach 
can be used even when little is known about the 
physical process. The use of the LMS filter in an 
adaptive scheme provides robustness and insensi- 
tivity to unmodeled modes. The penalty is slower 
convergence because of the comparatively large 
number of parameters. 

Previous MRAC schemes which used LMS filters 
have been essentially in open-loop or off-line 
configurations. Closed-loop control is desired 
because of its ability to suppress both distur- 
bances and the effects of abrupt changes in plant 
parameters. One of the principal factors that has 
hampered the development of closed-loop adaptive 
control is the interaction between the feedback of 
the learning process and that of the control sig- 
nals. This interaction greatly complicates the 
analysis underlying the design of dependable con- 
trol systems. A closed-loop MRAC scheme based on 
LMS filters have recently been proposed” that has 
been shown to work well with a wide range of 
plants, even for processes that are barely stable. 

This paper presents a further study that 
extends the work presented in Ref. 8. The adap- 
tive algorithm is first described, followed by a 
demonstration of its performance. Next, the heur- 
istic arguments are provided to analyze its con- 
vergence properties and simulation results demon- 
strate its robustness. Further simulations show 
the scheme's tolerance for and response to changes 
in plant characteristics and to noise. Finally, 
the potential applications of this adaptive con- 
troller are discussed. 


The Concept 

The LMS filter, shown in Fig. 1, consists of 
an input signal x(t) that is sampled and pro- 
cessed by a set of delays (a "tapped delay line," 
where g is a delay operator), variable weights 
W! which multiply the signals at the delay line 
taps, a summer L where the weighted signals are 
combined to form the filter output y and an 
adaptation algorithm to adjust the weights to make 
the filter output match a desired signal. 
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Fig. 1 The LMS filter. 


The filter error equation, in discrete form, 
where dj is the desired output, yj is the 
actual filter output and w is the weight vector, 
is 


where 
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-r-i 


r * 


j 



(D 


( 2 ) 


X 


j-Nj 


The weights are adjusted using a gradient algo- 
rithm to minimize the square of the filter error 
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In £he following, ’’gradient" will refer to 
(3e./3w), while "error gradient" will refer to 
(3e J ./3w). The term m is a gain factor that is 
chosen to assure the stability of the gradient 
algorithm. Using Eq. (1) the error gradient is 
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and 


AWj = auejXj 


( 6 ) 


The properties of this filter have been studied 
extensively^’ ^ anc j are briefly summarized here. 

Eq. (3) represents a difference equation which can 
be analyzed for stability and convergence. A 
sufficient condition for stable convergence is 
(0 < m < 1/x^x ). In the implementation of the 
LMS filter wS let 


(F > 1) (7) 


and use F as a design parameter. The theoreti- 
cal settling time of the filter can be shown to be 
(N + t)F iterations, and the accuracy of the 
convergence is related to 1/F, so the parameter 
F may be used to balance the conflicting require- 
ments of speed and accuracy. Note that by choos- 
ing u in this manner, the parameter change, 

Eq. (6), is normalized with respect to the input 
power . 

A necessary condition for the convergence and 
stability of the LMS filter is for the error equa- 
tion, Eq. (1), to be linear in the weight vector. 
This requirement poses a challenge to the design 
of a closed-loop adaptive controller using LMS 
filters because the desired filter output d can 
become a function of the filter weights, possibly 
in a nonlinear manner. Other considerations in 
the development of a satisfactory controller are 
the realizability of the error gradient and 
whether the controller is determined "directly" or 
"indirectly." Indirectly means that the con- 
troller is determined from an identified plant 
model, and therefore involves at least one addi- 
tional stage beyond that required for directly 
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Fig. 2 The system configuration. 


determining the controller. As was shown in 
Ref. 8, a closed-loop configuration that is 
stable, realizable, and direct is extremely diffi- 
cult to design. The configuration presented in 
this paper yields an expression for the closed- 
loop gradient which strongly indicates global and 
uniform convergence properties. 

Figure 2 shows the system configuration: 

P(s) is the unknown plant; M(s) is the open-loop 
reference model; I(s) is an integrator; G(s) is 
the adaptive controller structured as an LMS fil- 
ter; G (s) is an exact, current copy of the fil- 
ter G(s); and T(s) is the desired closed-loop 
reference model, obtained directly from M(s), and 
is used for comparison only. Inputs to the system 
are u the desired input, and n which is addi- 
tive noise. It is easily verified that, with 
respect to the filter, the process and measurement 
noise are equivalent, and therefore one noise 
source will suffice for the simulations. Notice 
that the configuration has two different modes of 
operation. When the switches are in Position 1, 
G(s) and G c (s) are not in loop, and therefore do 
not affect the input or output of the plant. This 
state is called the ’’open-loop" state. With the 
switches in Position 2, G(s) and G c (s) form the 
controller for the plant. This state will be 
referred to as the "closed-loop" state. 

The adaptation process has to adjust G{s) so 
that P(s)G(s) M(s) . Essentially, the only 
a priori information needed for the unknown plant 
is that it be stable and minimum phase. The LMS 
filter is represented in continuous time as 

N 

G(s) = £ g 1 ( s ) w . (8) 

i=0 


where g*(s) represents a delay of i time steps. 
The choice of the number of weights N and the 
value of the time delays are determined a priori 
from the characteristics of the reference model 
M(s). Rules for choosing these quantities are 
given in Ref. 8. 


In the open loop state, the filter error is 
given by* 


e(t) = 


[M( s ) - G(s)P(s) ] I (s) 

1 + M(s)I(s) U{t) 


( 9 ) 


which is linear in G(s), and therefore in w. 
The ith error gradient component is 


3e( t) _ 3e(t) 3G(s) 
3w i “ 3G(s) aw.^ 


-P(s)I(s) 

1 + M(s)I(s) 


g 1 ( s )u( t ) 


= -g^sjztt) (i = 0 I) (10) 

The signal g i (s)z(t) is the signal z(t) 
delayed i time steps and is realizable. So, 
both the linearity and realizability conditions 
are satisfied for the open-loop configuration. 


In the closed-loop state, the filter error is 
given by** 


e 


(M - GP)GI 
1 + GPI 


(ID 


which is not linear in the weights. The error 
gradient can be shown to be 


3e _ i 1 i 

3 Wi = ' g Z * G(1 ♦ GPI) g e 

If the system has converged and PG * M, then 
Eqs . (11) and (12) become 


•Presently, it is assumed that the noise is 
zero. The effect of noise will be discussed later 
in the paper. 

**In the rest of the paper, for brevity, the 
complex frequency variable s and the dependence 
on time t will not always be explicitly written 
(i.e., P will stand for P(s) and z for 
z ( t ) ) . 
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Thus, the error gradient assumes its correct open- 
loop form as determined by Eq. (10). 

It is evident that the system will not start 
up properly in the closed-loop state because the 
error equation, Eq. (11), is not linear in the 
weights as required. The initial approach to 
resolve this problem is to start the system in the 
open-loop state and to switch to the closed-loop 
state after the filter has converged. After that, 
if the changes in the plant are moderate the 
system can reconverge because the gradient, 

Eq. (14), is approximately correct. The issue of 
whether the system can be started in the closed- 
loop state will be addressed again shortly. 


Performance Demonstration 

This section demonstrates the performance of 
this adaptive controller. Let the unknown plant 
be 


P(s) = -p — (15) 

s + 0.1s + 25 

P has a pair of complex poles with natural fre- 
quency u of 5 and damping factor c of 0.01. 

Let the open-loop reference model be 

M(s) = -r 15 (16) 

s d + 6.5s + 9 

The relation between the open and closed-loop 
reference models is given by 


T(s) 


M(s) 

s + M(s) 


10 

s 3 + 6.5s^ + 9s ♦ 10 


(17) 


The filter G has 61 weights (N = 60) with a tap 
spacing of 0.04 sec, and F is chosen to be 10. 
Ideally, when the system has adapted perfectly, 

GP should be equal to M, and therefore 


G(s) 


M(s) . O.H(s 2 + 0.1s ♦ 25) 
P(s) (s 2 + 6.5s + 9) 


( 18 ) 


Example 1: The actual results of using the 

adaptive controller with this plant and reference 
model are shown in Figs. 3 through 5. These 
figures were generated from a run of 1200 itera- 
tions (48 sec) with the first 600 iterations being 
in the open-loop state and the rest In the closed- 
loop state. The final filter weights representing 
the finite impulse response (FIR) are shown in 
Fig. 3 along with the infinite impulse response 



0 .4 .8 1.2 1.6 2.0 2.4 
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Fig. 3 Estimated FIR and IIR of G(s), Example 1. 



Fig. 4. Step response of adapted system and 
reference model T(s), Example 1. 
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(IIR) of the ideal G(s) as represented by 
Eq. (18). The shapes of the FIR and IIR are very 
similar and one can conclude that the system has 
adapted well. Figure 4, which verifies this con- 
clusion, shows the step response of the reference 
model T(s) and that of the adapted system (that 
is, the step response of the system with the 
weights frozen at the values obtained at the end 
of the run). Figure 5 shows the time history of 
four of the filter weights throughout the duration 
of the run. The weights had settled after about 
10 sec (250 iterations) and after 25 sec (625 
iterations) they were very steady. This overall 
settling time agrees well with our expectations 
((N + 1 )F = 610 iterations). If Fig. 5 is exam- 
ined closely it appears that the weights are 
drifting at the end of the simulation, from 25 to 
50 sec, but in actuality the controller is simply 
adjusting to a very small change in the process— 
there are slight differences in the simulation 
between the open- and closed-loop states. After 
this adjustment, that is after the 50 sec mark, 
the weights are constant. The steadiness of the 
weights will be apparent in Fig. 9 which accom- 
panies Example 2 further on in the paper. 

The system works just as well as in Example 1 
when the damping of the second-order plant is 
varied from 10"3 to 1 and its relative degree 
varied from one to two. The input signal, i, used 
in Example 1, and for all the other examples of 
the paper, was white noise. Other input sequences 
such as colored noise and a series of random steps 
have also been used in simulations with good 
results. 


Convergence Properties 


With these expressions, the following heuristic 
argument is offered. Equation (4), which 
expresses the parameter updates, using Eqs. (19) 
and (21), can be written as 


■aw 0 " 



‘ U j ' 


= 2yej(Drp or 

D I> 

U j-1 

. fiW N. 

J 


. U j-N. 


The difference between the implemented and theo- 
retical gradients is the transfer function that 
filters the signal g*u. For the system to con- 
verge, the implemented error gradient must "point” 
in essentially the same direction as the theoreti- 
cal error gradient. This fact implies that the 
corresponding elements of the two error gradients 
must have the same sign, which means that the 
transfer functions D T and Dj must have similar 
phase responses. 

We will look at an example to illustrate this 
statement. Let the plant and the model be those 
of Eqs. (15) and (16). The I, as in Eq. (19), 
stands for the integrator and is 

I(s) = 1/s (23) 

As a starting condition for the filter, let the 
weights be set to 

f w o = 1 

G: < (24) 

=0 (i = 1, H) 


To understand whether the system can start up 
and converge completely in its closed-loop state, 
we again look at the expressions for the error 
gradient. As was indicated before, the imple- 
mented and theoretical gradients become equal once 
the system has converged. However, the question 
is how similar the two gradient expressions are 
before the filter has converged to the correct 
values. Equation (12) representing the theoreti- 
cal error gradient can be rewritten in terms of 
the input u as 


g- ■ ^- GP1 < ; y :pl > g ‘u * V“ 

dW i ( 1 + GPI y T 


The implemented gradient (Eq. (14)) is 


9e 
3w . 


= -g Z 


( 20 ) 


or 


it* (I T GPI) 6 iu = V U (21) 


Then the initial value of G(s) is 

G(s) = 1 (25) 

Note that the system must be started in closed- 
loop position with at least one nonzero filter 
weight because otherwise the input signal will not 
get past the first filter and cannot start up 
(Fig. 2). 

The transfer functions D T and Dj can be 
evaluated using the expressions for M(s), P(s), 
I(s), and G(s) in accordance with Eqs. (15), (16), 
(23), and (25). The Bode phase and magnitude 
plots are shown in Figs. 6 and 7. The phase plots 
are very similar, differing at most by 30° in a 
small-frequency range, from 0.8 to 3.5 rad/sec. 
This fact means that the elements of the imple- 
mented and theoretical gradients will have the 
same signs. Thus, the implemented gradient 
changes the weights in the correct direction so 
that they will move closer to their correct 
values, and the two gradients will match even more 
closely in future iterations. The magnitude plot 
shows that the implemented gradient is slightly 
smaller, meaning that the system will converge 
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FREQUENCY, rad/tec 

Fig. 6 Phase response of theoretical error gra 
dient, D T , and implemented error gradient, Dj . 



Fig. 7 Magnitude response of theoretical error 
gradient, D T , and implemented error gradient, Dj. 

more slowly than predicted. This premise is 
supported by the inspection of Eq. (12). 

Example 2: According to this heuristic 

argument, at least for the example of Eqs. (15) 
and (16), the system should be able to converge 
even when started up in the closed-loop config- 
uration given the initial weights of Eq. (24). 

The simulation results confirm this assertion. 
Figure 8 shows the resulting step response and 
Fig. 9 shows the convergence of some of the filter 
weights. These figures were obtained with the 
same number of iterations (1200) as those of the 
previous example. The step response of Fig. 8 is 
not quite as good as that shown in Fig. 4, and 
that is because of the slower convergence of the 
system in the closed-loop state. Nonetheless, the 
step response of the system in the present example 
does get as good as that of the previous example 
given some more time. 

A practical way is to start the system in the 
open-loop state with all the weights set to zero, 
and then run it for, say, five iterations and 
switch to the closed-loop mode. Numerous 



Fig. 8 Step response of adapted system ancP 
reference model T(s), Example 2. 



TIME, tec 

Fig. 9 Time history of filter weights, Example 2. 


simulations have confirmed convergence by this 
method. Although the discussion presented here 
showed convergence for a specific example only, 
the idea can be extended to a more general test. 
Given an initial G and the reference model M, 
one can find the range of possible plants P for 
which the resulting phase plots are similar enough 
for the algorithm to converge. Conversely, given 
a range of P, one can calculate the range of 
possible reference models M that assure 
convergence. 


Changes in Plant 

The foregoing demonstrates that the con- 
troller adapts well to an unknown plant. It is 
equally important that an adaptive controller 
respond appropriately to plant changes that occur 
after the system has reached its steady state. 
Because the system will be in the closed-loop 
state, the previous arguments regarding the inac- 
curacies in the gradient calculation are still 
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pertinent; that is, the allowable variations in 
plant parameters depend on the effect they have on 
the phase of Dj and D T . The performance of this 
scheme under such situations is demonstrated by 
the following two examples. For both examples the 
run of Example 1 was repeated for the first 
40 sec, at which point a step change in plant 
parameters was introduced. 

Example 3: For this example, the damping 

ratio of P(s) was changed from c = 0.01 to 
C = 0.05, a five-fold increase. Figure 10 shows 
the time history of some of the filter weights 
during this run. We see that after the weights 
had settled the first time, they adjusted to the 
new plant, and then settled down again at the end 
of the run. The resulting step response, Fig. 11, 
is slightly different than that of Fig. 4, but is 
essentially as good. 



Fig. 10 Time history of filter weights, 
Example 3. 



Fig. 11 Step response of adapted system and 
reference model T(s), Example 3. 


Example 4: For this example, the numerator 

of P(s) was increased by 50$, from 25 to 37.5. 
Thus, the gain of the plant was increased. Fig- 
ure 12 shows the filter weights. The change in 
weights after 40 sec is dramatic, but accurate, as 
shown by the resulting step response in Fig. 13. 



Fig. 12 Time history of filter weights, 
Example 4. 



Fig. 13 Step response of adapted system and 
reference model T(s), Example 4. 


The Effect of Noise 

It is difficult to design a "direct" adaptive 
controller which is not biased by noise. The 
reason is that the noise produces errors in the 
estimation process which then circulate through 
the system. When noise is included, the open-loop 
filter error is 

* • S Tff ii » - «» <»> 

and the error gradient is 
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|i- = -ghz ♦ n) : -g\ (27) 

Compare these with Eqs. (9) and (10). Since the 
filter error and the error gradient are multiplied 
together to form the change in filter weights, 

(Eq. (4)), terms in v? will appear, and there- 
fore the filter weights will be biased. The 
filter error and the error gradient for the 
closed-loop state also include noise terms and 
similarly cause bias in the weights. Thus, bias 
in the filter weights is inevitable with this 
configuration. How seriously does the noise- 
induced bias affect the performance of the 
system? The following examples provide indi- 
cations. For both examples the noise signal is 
white noise and is uncorrelated with the input 
signal . 


Example 5: Figure 14 was produced with a 

signal-to-noise ratio of 10, and the system was 



L i 1 1 1 1 1 1 1 1 1 I L J 
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TIME, »c 


Fig. 14 Estimated FIR and HR of G(s), 
Example 5. 


started up in the closed-loop state with initial 
weights as in Eq. (24). Comparing this FIR to 
that of Fig, 3, we see some distortion of the 
filter weights because of noise. However, Fig. 15 
shows that the step response of the adapted system 
is still good. 

Example 6: Even in a very noisy system, with 

a signal-to-noise ratio of 2, the step response is 
still quite close to that of the reference model 
as shown in Fig. 16. Although the system is 
biased in the presence of noise, the degradation 
in performance is minor. 


Applications 

The preceding sections have demonstrated 
excellent performance of the adaptive scheme of 
Fig. 2 with regard to initial adaptation to an 
unknown plant, tolerance to noise, and response to 
changes in plant parameters. In the following, we 



Fig. 15 Step response of adapted system and 
reference model T(s), Example 5. 



Fig. 16 Step response of adapted system and 
reference model T(s), Example 6. 


discuss potential extensions and applications of 
this adaptive controller. 

In-Flight Adaptation 

For the control systems that go through 
large, but known, changes in operating environment 
and required performance (e.g., high-performance 
aircraft), a table of filter weights defining 
controllers for the different regimes could be 
created off-line and then used in flight as neces- 
sary. The advantages of using the adaptive con- 
troller of this paper for such systems are the 
same as have been shown in the examples, espe- 
cially with regard to robustness and the ability 
to respond to variations in the plant. 

Unmodeled Modes 

In many cases, the plant is not completely 
unknown; a model is available, but is in some way 
incomplete. As long as a reasonable assumption 
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can be made as to the order of the plant, so that 
the chosen reference model produces a realizable 
controller, one can take advantage of the partial 
knowledge by designing a controller that will make 
the known plant behave as desired and then let an 
adaptive controller handle the unknown portions of 
the plant. 

One possible configuration with a controller 
with nominal and adaptive parts is shown in 
Fig. 17, where the two parts are in parallel. To 
demonstrate the use of this configuration we use 
the following example. 

Example 7: Let the actual plant be 

P(s) = -p — (28) 

s + 2s + 25 


which results in 


G(s) 


437.5 

s 2 + 15s + 81 


(33) 


Figure 18 shows the step response of the 
system with the nominal controller only, and that 
of the desired closed-loop reference model for 
comparison. The response is poor. The undesired 
oscillation originates from the unaccounted for 
spring forces. When the adaptive controller, G, 
is included, the response is much better as shown 
in Fig. 19. Thus, the adaptive controller is 
effective in compensating for the imperfections of 
the nominal controller. 


Fine Tuning 


Let the known, or nominal, plant be 


P (s) 10 10 

V s ' ‘ s(s + 2) 


2 

s + 2s 


(29) 


Equations (28) and (29) can be thought of as a 
mass/spring/damper system where the spring is 
unknown. The reference model, M(s), is chosen as 


M(s) = 


175 


(30) 


s + 15s + 81 
The resulting nominal controller is 


c„(.) . ,J„ 

n 3 s 2 + 15s + 81 


The adaptive controller, G, should adjust so that 
(G(s) + G n (s)] = (32) 


As an extension of the concept illustrated in 
the previous example, the adaptive scheme can also 
be used to n fine tune” existing control systems. 
The plant, P(s), of Fig. 2, can actually be an 
entire system of process and local controller. 

The local controller is designed to obtain a 
desired system performance, but because of inaccu- 
racies in modeling and implementation, there is 
some degradation in system performance. The adap- 
tive controller can then be added on as an addi- 
tional loop of the system that will improve the 
performance to the desired level. 

A potential application of this idea is in 
robotics. The equations of motion of a robot arm 
are generally well known, and straightforward 
control algorithms have been designed. 1 ^ However, 
there is often uncertainty in the measurement of 
some of the physical characteristics (e.g., iner- 
tias and link lengths) that causes the performance 
to fall below expectations. The present adaptive 
scheme could be used for fine tuning of such a 
robot controller. It has also been suggested that 
the drive systems of robots need to be well mod- 
eled and these models be used in the development 
of robot controllers. 11 Some of the proposed 
models are very similar to the "unknown" plants 



Fig, 17 A modified system configuration which includes a nominal as well as an adaptive 

controller . 
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TIME, sec 


Fig- 18 Step response of system with nominal 
controller only and that of the reference model 
T(s), Example 7. 



0 12 3 


TIME, sec 

Fig. 19 Step response of adapted system and 
reference model T(s), Example 7. 

used in our simulations, and the present adaptive 
scheme could be used to achieve drive system 
response that eases the development of such robot 
controllers . 


Concluding Remarks 

It has been shown that the impulse response 
modeling approach used in the development of the 
closed-loop model reference adaptive control 
scheme presented in this paper provides excellent 
overall performance. The scheme adapts well to an 
unknown plant and can converge in some cases with- 
out the need of a start-up scheme, continues to 
adapt to changes in plant behavior, and tolerates 
large amounts of noise. Since the only essential 
a priori knowledge of the plant that is needed is 


that it be stable and minimum phase, this concept 
could be extremely useful in control situations 
when it is difficult to determine an accurate 
model of the plant. The scheme may also find uses 
for the control of partially known plants, for the 
"fine tuning" of systems that already have accept- 
able control performance, and for the suppression 
of parasitic modes. 
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